The Power of Approximating: a Comparison of Activation Functions
نویسندگان
چکیده
We compare activation functions in terms of the approximation power of their feedforward nets. We consider the case of analog as well as boolean input.
منابع مشابه
Error bounds in approximating n-time differentiable functions of self-adjoint operators in Hilbert spaces via a Taylor's type expansion
On utilizing the spectral representation of selfadjoint operators in Hilbert spaces, some error bounds in approximating $n$-time differentiable functions of selfadjoint operators in Hilbert Spaces via a Taylor's type expansion are given.
متن کاملA novel method based on a combination of deep learning algorithm and fuzzy intelligent functions in order to classification of power quality disturbances in power systems
Automatic classification of power quality disturbances is the foundation to deal with power quality problem. From the traditional point of view, the identification process of power quality disturbances should be divided into three independent stages: signal analysis, feature selection and classification. However, there are some inherent defects in signal analysis and the procedure of manual fe...
متن کاملBuckling and vibration analysis of angle -ply symmetric laminated composite plates with fully elastic boundaries
The main focus of this paper is on efficiency analysis of two kinds of approximating functions (characteristic orthogonal polynomials and characteristic beam functions) that have been applied in the Rayleigh-Ritz method to determine the non-dimensional buckling and frequency parameters of an angle ply symmetric laminated composite plate with fully elastic boundaries. It has been observed that o...
متن کاملComparison of Behavioral Activation-Inhibition Systems and Sense of Coherence in Bodybuilders with and Without Use of Anabolic-Androgenic Steroids
Abstract Introduction: Anabolic-androgenic steroids are one of the powerful drugs that cause long-term hormonal and psychological changes that can have a wide range of side effects for the athletes. Objective: The purpose of this study was to compare the Behavioral Activation-Inhibition Systems and Sense of Coherence in Bodybuilders with and without Use Anabolic-Androgenic Steroids. Material...
متن کاملAn algorithm for approximating nondominated points of convex multiobjective optimization problems
In this paper, we present an algorithm for generating approximate nondominated points of a multiobjective optimization problem (MOP), where the constraints and the objective functions are convex. We provide outer and inner approximations of nondominated points and prove that inner approximations provide a set of approximate weakly nondominated points. The proposed algorithm can be appl...
متن کامل